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Abstract — Pursuit  strategies  for  interacting  particles  and 
feedback  laws  to  execute  them  are  formulated  in  three  dimen¬ 
sions,  focusing  on  constant  bearing  (CB)  pursuit  -  a  case  of 
interest  in  biology.  In  the  analysis  of  such  laws  for  the  setting 
of  n  particles  engaged  in  cyclic  pursuit,  we  reveal  interesting 
invariant  manifold  dynamics  and  associated  explicit  integrabil- 
ity  properties,  as  well  as  conditions  for  special  solutions  such 
as  relative  equilibria. 

I.  Introduction 

This  paper  explores  the  geometry  of  pursuit  strategies  in 
three  dimensions,  focusing  on  a  particular  class  of  strategies 
known  as  constant  bearing  (CB)  pursuit.  It  also  extends  the 
program  of  analysis  of  cyclic  pursuit  in  [2]  toward  design 
for  collective  behavior  of  n  particles  in  three  dimensions. 
While  interest  in  the  mathematics  of  pursuit  has  a  long 
history  (see  [10]),  the  more  recent  concerns  of  cooperative 
robotics,  and  problem  solving  using  collective  intelligence 
(see  introduction  and  references  cited  in  [2]),  have  shaped 
the  course  of  our  research.  In  particular,  we  envision  pos¬ 
sible  technological  applications  such  as  collective  control 
of  “flocks”  of  UAV’s  operating  in  three-dimensional  space. 
In  this  paper,  and  in  our  previous  work,  a  unifying  theme 
centers  on  the  idea  that  feedback  control  laws  that  execute 
pursuit  strategies  may  serve  as  effective  building  blocks 
for  collective  behavior  in  nature  and  in  machines.  Our 
interest  in  CB  pursuit  as  a  strategy  worthy  of  investigation  is 
underscored  by  observations  of  this  in  nature,  specifically  in 
the  high  speed  stoop  behavior  of  the  peregrine  falcon  diving 
from  great  heights  to  hunt  prey  ([8], [9]). 

The  constant  bearing  pursuit  law  in  the  planar  setting  [7] 
involves  a  relative  bearing  error  and  a  term  similar  to  the 
motion  camouflage  law  in  [3],  In  section  III  of  this  paper, 
the  appropriate  extension  of  the  cyclic  CB  pursuit  feedback 
law  to  three  dimensions  is  formulated  (see  equation  14).  This 
leads  to  a  derivation  of  an  invariant  manifold  for  CB  pursuit 
and  dynamics  on  this  manifold  (see  equation  17).  Section 
IV  is  devoted  to  the  special  case  of  n  =  2  that  we  refer 
to  as  mutual  CB  pursuit,  in  analogy  with  mutual  motion 
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camouflage  (MMC)  investigated  in  [1],  This  case  reveals  the 
presence  of  conservation  laws  leading  to  explicit  integrability 
of  the  dynamics,  a  key  contribution  of  this  paper.  The  paper 
ends  with  conditions  for  existence  of  rectilinear  and  planar 
circling  relative  equilibrium  motions  for  cyclic  CB  pursuit 
dynamics  for  general  n. 

II.  Modeling  interactions 

The  evolution  of  a  system  of  multiple  agents  moving  in 
three-dimensional  space  can  be  described  in  terms  of  unit- 
mass  particles  tracing  out  twice  continuously-differentiable 
curves,  with  system  dynamics  derived  from  the  natural  Frenet 
frame  equations.  (See,  for  example,  [4]  for  details.)  As  in 
figure  2  of  [4],  the  state  of  the  ith  particle  (i.e.  agent)  with 
respect  to  a  fixed  inertial  frame  is  denoted  by  the  position 
vector  r;  and  the  respective  natural  Frenet  frames  (x^,  y Zj). 
If  we  constrain  the  agents  to  move  at  unit  speed,  then  the 
dynamics  of  a  system  of  n  agents  can  be  described  by 

f  /  xi; 

x,;  =  U-iYi  +  ViZ  i, 

Yi  =  -UiX-i, 

±i  =  —  tijXj,  i  =  1,2, . . .  ,n,  (1) 

where  it,  and  v7  are  the  natural  curvatures  viewed  as  controls 
and  are  required  to  be  S.E(3) -invariant  (i.e.  invariant  to 
translations  and  rotations  of  the  inertial  frame).  We  define 
the  baseline  vector  r^+i  =  r;  —  r.j+i,  with  addition  in  the 
indices  interpreted  as  modulo  n,  and  prohibit  “sequential 
colocation”  (i.e.  we  assume  |ri  i+1|  >  0  for  all  f).  This 
means  that  we  restrict  our  analysis  away  from  the  point  of 
actual  capture  or  rendezvous,  ensuring  that  the  control  laws 
of  section  III  are  well-posed.  Explicitly,  we  let  the  state  space 

M state  —  |(ri5Xi,yi,Zi, . . .  ,rn,  xn ,  yn ,  zn)  | 

TM+1  7^  °>  *  =  !,2,..  .  ,nj,  (2) 

where  it  is  understood  that  r,  £  R3  and  that  {x,,yi,z,}  are 
orthonormal  vectors  in  R3  for  each  i.  This  paper  is  focused 
on  a  particular  setting  of  cyclic  pursuit  (i.e.  agent  i  pursues 
agent  i+ 1  modulo  n),  defined  by  the  constant  bearing  pursuit 
strategy  in  section  III-B. 

III.  Pursuit  strategies  and  steering  laws 

Steering  laws  for  the  execution  of  planar  pursuit  strategies 
under  the  framework  described  in  section  II  have  been 
developed  for  classical  pursuit  (CP)  and  constant  bearing 
pursuit  [7]  as  well  as  motion  camouflage  (MC)  pursuit  [3],  A 
three-dimensional  version  of  the  motion  camouflage  pursuit 
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law  is  also  developed  in  [5],  Here  we  derive  pursuit  laws 
for  the  execution  of  classical  pursuit  and  constant  bearing 
pursuit  strategies  in  R3. 


A.  Classical  Pursuit 


The  classical  pursuit  strategy  specifies  that  the  pursuer 
should  always  move  directly  towards  the  current  location  of 
the  pursuee.  As  in  the  planar  case  [7],  we  define  our  cost 
function  by 


A?p  = 


r  i 


i,i+ 1 


r  4 


i,i+ 1 1 


(3) 


noting  that  Afp  £  [—1,1]  and  Afp  =  —1  corresponds  to 
attainment  of  the  CP  strategy.  With  the  following  notation 


-  A  ,'i+l 

Xi  =  X,  •  - - r 

ki.i+il 


Vi  =  y»  • 


_  a  1 

Zi  =  z  i  •  t - r 


(4) 


we  have. 

Proposition  1:  Consider  a  two-particle  system  in  which 
(u2,V2)  are  arbitrary  (but  continuous  and  bounded)  and 
(«i,i>i)  are  prescribed  by 


1 

( ■  r  \ 

Ui  =  -Ml  - 

[Zl‘  v  H/J 

1 

( ■  r  \ 

V!  =  -/jLZi  +  r 

M 

r1’  v  H/J 

where  //  >  0  is  a  control  gain  and  r  =  ri  —  r2.  Then  under 
the  closed-loop  dynamics  (1),  Afp  <  0  with  Afp  =  0  if 
and  only  if  Afp  =  ±1. 

Proof:  We  proceed  by  differentiating  Af p  along  trajectories 
of  the  closed  loop  dynamics.  First,  note  that 

KhK' 

where  w,  the  transverse  component  of  the  relative  velocity, 
is  defined  by 


w  =  r  r 


=  — r  x  r  x 


(See  [5]  and  [7].)  Then  differentiating  Afp  we  have 


(7) 


Afp  =  uiyi  +  v\Zi  +  A-  (xi  •  w) 


=  -pyi  -  p4  +  r~\  (Xl ' w) 

r 


zi 


r  x 


y i  -  zi 


yi  •  r  x 


-k(i-(aD2) 


(8) 


where  we  have  progressed  from  the  second  equality  to  the 
third  equality  by  writing  out  the  full  expressions  for  yi  and 
Z\  and  using  the  identity  (a  x  b)  •  (c  x  d)  =  (a  •  c)(b  ■  d)  — 
(a  •  d)(b  •  c)  for  arbitrary  vectors  a,  b,c,d.  The  claims  of 
Proposition  1  readily  follow  from  (8).  □ 


B.  Definition  of  the  Constant  Bearing  Pursuit  strategy 

In  the  planar  case,  the  notion  of  constant  bearing  strategy 
simply  extends  CP  by  specifying  a  fixed,  possibly  nonzero 
angle  between  pursuer  heading  and  the  relative  location  of 
the  target.  The  following  specifies  an  extension  of  this  idea 
to  three  dimensions. 


Definition  1:  Given  a  two-particle  system  with  dynamics  (1) 
and  a  parameter  a\  £  [—1,1],  we  say  particle  1  has  attained 
the  CB(ai)  pursuit  strategy  if  xi  •  ^  =  ai. 

Remark:  Given  a  scalar  parameter  a  £  [—1,1]  and  an 
arbitrary  unit  vector  q  regarded  as  a  point  on  the  unit  sphere 
S2,  the  set  jy  £  S2  q  •  y  =  a  j  defines  a  small  circle  (i.e. 
the  intersection  of  a  sphere  with  a  plane  that  does  not  pass 
through  the  center  of  the  sphere)1.  Since  xi  and  ^  are  both 
unit  vectors,  we  can  think  of  the  CB(ai)  pursuit  strategy  as 
prescribing  a  small  circle  centered  around  the  point  ^  £  S2. 
CB(oi)  pursuit  holds  when  Xj  lies  on  that  small  circle. 


Remark:  Observe  that  this  definition  of  the  three- 
dimensional  CB  pursuit  strategy  is  fundamentally  different 
from  the  planar  version  presented  in  [7]  (i.e.  i?(a)x!  •  [  = 
—  1,  where  i?(a)xi  is  the  vector  xi  rotated  counterclockwise 
in  the  plane  by  the  angle  a )  in  that  the  planar  version 
prescribed  not  only  a  constant  bearing  angular  offset  but  also 
a  particular  direction  (i.e.  counterclockwise)  for  the  offset. 
We  can  relate  the  CB  strategy  presented  here  to  the  planar 
strategy  as  follows.  Given  unit  vectors  xi  and  ^  in  the  plane 
and  the  two  statements  i?.(a)xi  •  ^  =  —  1  and  Xi  •  j^y  =  a, 
we  seek  to  define  the  relationship  between  a  and  a.  If  we 
define  0  as  the  signed  angle  (CCW  rotation  positive)  from 
X!  to  |^| ,  then  cos 6  =  a  and  \9  —  a\  =  it,  i.e. 

cos(f?  —  a)  =  cos  6  cos  a  +  sin  9  sin  a  =  — 1.  (9) 


This  relationship  holds  only  if  (cos  a,  sin  a)  = 
—  (cos  9,  sin  9),  and  since  cos  9  =  a  and  sinO  =  i  V 1  —  a2, 
the  two  discrete  possibilities  are  given  by  (cos  a,  sin  a)  = 
(—a,  tVI  —  a2).  Therefore  the  CB  strategy  of  Definition  1 
differs  from  the  planar  strategy  (in  [7])  in  that  it  allows  for 
two  discrete  possibilities  for  pursuit  geometries  as  opposed 
to  the  single  geometry  prescribed  by  the  planar  strategy. 


We  define  a  CB  cost  function  for  agent  i  by 


A,;  = 


f  rM+l  ) 

(  xi  '  ,  , 

1  -  ^ 

v  Tm+ 1  ' 

1  2 


(10) 


with  0  <  Aj  <  max  [4(1  —  a.j)2,  |(— 1  —  a,;)2].  Then  the 
CB  pursuit  strategy  of  Definition  1  is  equivalent  to  Aj  =  0. 


Remark:  At  first  glance,  it  may  appear  that  a  viable  alterna¬ 
tive  definition  for  the  three-dimensional  CB  pursuit  strategy 
is  obtained  by  letting  A  =  Bxi  ■  [| ,  where  B  £  SO( 3)  (the 
rotation  group  in  three  dimensions),  and  then  defining  the 
CB  pursuit  strategy  by  A  =  —  1.  This  definition  is  appealing 


LMore  precisely,  the  set  |y  E  S2  |  q  •  y  =  a  j  describes  a  small  circle 
only  if  a  7^  0.  For  a  =  0,  it  defines  a  great  circle. 
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since  it  is  the  obvious  extension  of  the  previously  mentioned 
planar  CB  pursuit  strategy.  However,  a  few  straightforward 
calculations  reveal  that  A  is  not  invariant  to  rotations  of 
the  coordinate  frame  (i.e.  not  50  (3  {-invariant)  and  therefore 
all  associated  pursuit  laws  will  be  inadmissible  under  our 
framework  (unless  B  is  the  identity  matrix). 


C.  A  feedback  law  for  CB  Pursuit 

Proposition  2:  Consider  a  two-particle  system  in  which 
(u2 ,  vf)  are  arbitrary  (but  continuous  and  bounded)  and 
(«i,i>i)  are  prescribed  by 


Ui  = 


Vi  =  -pi 


Zi  + 


1 

r 

1 


(11) 


where  p.i  >  0  and  we  assume  a,;  ^  ±1.  Define  the  set 


H  = 


{ (rl5  Xl,  yi,  Zl  **  ni  X- m  y mzn)  ^  Mstate 

Ai  <  —  e  +  min 


i(— 1  —  ai)2,  i(l  —  a,;)2 


2  =  1 


,2,  ...,n| 


(15) 


for  0  <  e  <C  minjg.f!  2,...,n}  §(±1  —  af)2.  Then  any  bounded 
trajectory  starting  in  O  converges  to  Mcb{ a)- 

Proof:  Note  that  fi  is  closed  (but  not  necessarily  bounded) 
and  excludes  states  for  which  Xi  =  ±1  for  any  i.  Making 
use  of  (10)  we  define  A  =  ]T]"=i  A?:,  observing  (from  (12)) 
that 


A=-2^2fHAi(l-x1)  (16) 

i=l 


where  pi  >  0  is  a  control  gain.  Then  under  the  closed-loop 
dynamics  (1),  Ai  <  0  with  Ai  =  0  if  and  only  if  Ai  =  0  or 

Xl  '  H  ~  ±1' 

Proof:  By  a  series  of  calculations  analogous  to  the  derivation 
of  (8),  it  is  possible  to  show  that 

At  =  -p i  (. x i  -  ai)2  (l  -  xf)  =  -2/nAi  (l  -  x\)  ,  (12) 

from  which  the  result  follows.  □ 

D.  An  invariant  submanifold  for  cyclic  CB  pursuit 

As  in  previous  work  on  planar  cyclic  pursuit  [2],  we  define 
the  submanifold  of  system  states  for  which  each  agent  i 
pursues  agent  ( i  +  1)  modulo  n  with  a  pursuit  law  of  the 
form  (11),  and  all  agents  have  attained  CB  pursuit.  Since 
A;  =  0  if  and  only  if  agent  i  has  attained  CB  pursuit  of 
agent  ( i  +  1),  we  define  the  submanifold  MCb(&)  C  Mstate 
by 

A/ic B(a)  —  ^(tT,xi,yi,zi,..., rn , xn , y n , zn)  (E  A^state  | 
A»  =  0,  *  =  1,2,.. .  ,n|,  (13) 


and  therefore  A  <  0  on  fl  with  A  =  0  on  O  if  and  only  if 
A*  =  0,  *  =  1,2,...  ,n.  The  hypothesis  of  boundedness  of 
the  trajectory  ensures  by  Birkhoff’s  theorem  the  w-limit  set 
is  nonempty,  compact  and  invariant.  Asymptotic  convergence 
to  Mcb( a)  follows  as  in  the  steps  in  the  proof  of  LaSalle’s 
Invariance  Principle  [6],  □ 

Note  that  on  Mcb(&)  the  terms  of  the  controls  (14)  which 
involve  the  gains  //,  are  identically  zero,  and  therefore  we 
can  formulate  reduced  (closed-loop)  dynamics  on  Mcb( a) 
for  *  =  1, 2, . . . ,  n  as 

f  /  —  , 

(z‘'(t,'‘+lXiSSTT))y‘ 

'(y"(tw+,xKAl))z( 

Xi-  (17) 

IV.  Mutual  CB  pursuit 


Yi  = 


1 

lrM+l| 

-1 

kM+il 


■  «,i+l 


Yi  *  i \i+i  x 


1 

lrM+l  I 
lri,i+l| 


-1 


rM+il 


where  a  =  {01,02 ,...,a„}.  It  follows  from  an  argument 
analogous  to  that  in  Proposition  2  that  Mqb( a)  is  an 
invariant  manifold  under  cyclic  pursuit  dynamics  (in  the 
sense  that  the  closed-loop  vector  field  is  tangent  to  the 
manifold).  In  the  following  proposition  we  prove  asymptotic 
convergence  to  Mcjb(h)  under  suitable  conditions. 

Proposition  3:  Consider  the  n-particle  cyclic  CB  pursuit 
system  governed  by  the  closed-loop  dynamics  (1)  with 
curvature  controls  for  the  ith  agent  prescribed  by 


As  a  first  step  towards  understanding  the  behavior  of  our 
system  under  cyclic  CB  pursuit,  we  analyze  the  two-particle 
“mutual  CB  pursuit”  case.  (This  can  be  compared  with  the 
analysis  of  “mutual  motion  camouflage”  in  [1].) 

For  analysis  of  two-particle  systems  in  three  dimensions, 
[4]  demonstrates  the  utility  of  considering  the  reduced  system 
(r, xi,X2)  evolving  on  R3  x  S2  x  S2,  where  r  =  ri  —  r2. 
Starting  from  (17),  we  derive  the  (r,xi,X2)  dynamics  on 
Mcb{ a)  by  first  computing 


Ui  =  -pi  ( Xi  -  at)  yi  - 
Vi  =  —pn  (. Xi  -  af)  Zi  + 


1 


lr,M+l  I 
1 

|r*,»+i| 


r  /  \  "i 

1 

■  „  rM+i  \ 

Xl  =  tt 

zi  (  1  X  .  .1 

|r|  [ 

L  V  lrM+il/J 

/  \ 

1 

( ■  „  Yi,i+ 1  \ 

=  - - 

y*  •  r*,i+ 1  x  ,  , 

.  Irl  L 

V  lr*,*+i|/_ 

ziUr  X  o)  -yi 


•((* 


yiUr  x  p)  -  zi 


Xl  x  (*■ x  r) 


(18) 


(14)  Here  we  have  made  use  of  the  so-called  BAC-CAB  identity. 
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Doing  similar  computations  for  particle  2,  we  arrive  at 


r  =  Xi  - 

-  x2 , 

1 

( .  r  \ 

xl  =  tt 

xi  x  r  x  — r 

M 

V  jr|  /  _ 

i 

( .  r  \ 

x2  =  TT 

x2  x  r  x  — r 

lrl 

L  v  lrlyJ 

=  jTj  (xi  x  g)  > 

=  o  (x2  x  ^) ,  (19) 


with  (  =  r  x  jjj  and  initial  conditions  governed  by  the 
Mcb( a)  constraints. 


A.  Explicit  solutions  for  system  behavior  on  MqB^ 

As  an  aid  to  intuition,  we  note  that  the  dynamics  of  the 
baseline  vector  r  can  be  reformulated  as 


(See  [5]  for  background  and  a  similar  approach.)  The  first 
term  captures  the  lengthening  or  shortening  of  the  baseline 
vector  r,  and  the  second  term  is  related  to  the  angular 
velocity  of  r  (with  r  viewed  as  an  extensible  rod  from  the 
perspective  of  particle  1).  Addressing  the  former  term,  we 
first  note  that  r  •  ^  ^  (|r|).  Defining  p  =  |r|,  we  have 


complete  solution  as 


r(*)  = 


a+t+po 
Po 

exp 


exp 


H*) 


(-4M 


Po 


1*0 


r0  for  a+  ^  0 
for  a+  =  0, 


for  r(0)  =  r0,  p0  =  |r0|  ,  x»(0)  =  : 


£  = 


(xi  -  x°) 


ro 


M' 


(26) 


Similarly,  by  analogous  calculations  from  (19)  we  have 
'exp(-^hn(^))x°  fora+^0 


xi(i)  = 


exP(~M^)x* 


for  a+  =  0. 


(27) 


B.  Center  of  mass  trajectory 

Prior  to  stating  and  proving  a  proposition  concerning 
the  motion  of  the  center  of  mass,  we  note  the  following 
calculation.  Define  0  £  [—1,1]  as 

0  =  (xi  x  x2)  •  ,  (28) 

the  signed  volume  of  the  parallelepiped  with  edges 
xj ,  x2,  |^j.  It  can  then  be  demonstrated  that 


p  =  (xi  -  x2)  •  -rj  =  ai 


02, 


(21) 


f(f)  = 


1 


a+t  +  po  L 


a+1  —  i 


(23) 


where  we  denote  a+  =  a\  +  a2  and  make  use  of  the  operator 
R3  — *  so(3)  which  maps  any  3-vector  T  =  (Ti,r2,r3) 
to  a  skew-symmetric  matrix  defined  by 


o  -r3  r2 
r  =  I  r3  o  -Ti 
-r2  r3  o 


(24) 


Since  a+l  and  £  commute,  for  u.\  f  0  we  can  derive  an 
explicit  solution  for  r  (t)  by 


r(f)  =  exp  (/ 


a+ 


a+r  +  po 


-dr 


exp  (  —  £ 


1 


/ o  a+r  +  po 


dr  )  r(0) 


a+t  +  po 
Po 


■  exp 


- £ln 

a+ 


a+t  +  Po 
Po 


r(0).  (25) 


A  straightforward  calculation  based  on  (23)  easily  yields  the 
result  for  the  a+  =  0  case,  and  we  can  therefore  write  our 


0  =  — xi  •  £  =  —  x2  •  £. 


(29) 


and  obtain 

p(t)  =  (ai  +  a2)  t  +  Po ,  for  po  =  |r(0)| .  (22) 

Turning  to  the  second  term  in  (20),  by  taking  the  derivative 
of  the  vector  cross  product  f  =  r  x  ^  along  trajectories  of 
(19),  one  can  show  that  £  is  in  fact  a  fixed  vector.  Substituting 
this  result  as  well  as  our  results  from  (21)  and  (22)  into  (20), 
we  can  express  our  r  dynamics  as 


By  differentiating  (29)  along  trajectories  of  (19),  one  can 
readily  show  that  0  is  a  constant  value  on  MqB (a)- 

Proposition  4:  Consider  a  two-particle  system  operating  on 
Mcb(sl)  according  to  the  closed-loop  mutual  CB  pursuit 
dynamics  (19)  with  initial  conditions  r.,(0)  =  r°  and  x,  (0)  = 
x3,  i  =  1,2.  Define  the  change  of  coordinates  f  ,  =  r,  —  r3, 
where  r3  is  defined  by 


r3  = 


^z°  -  ao  (ifSl  x  Pi)  for  1  ±  °’ 


for  £  =  0, 


(30) 


with  z0  =  \  (r?  +  r3),  a0  =  -  Po,  and  r0,  p0,  and 

£  as  in  (26).  Then  the  trajectory  of  the  center  of  mass  z  = 
2  (r-|  +  r2)  can  be  given  in  the  new  coordinates  z  =  z  —  r3 
by  the  following: 

(i.)  if  £  =  0,  then  z(t)  =  z0  +  ^  (x?  +  x3)  t 
(ii.)  if  £  7^  0,  but  a_  =  0,  then  z(t)  =  — ~^£t 


I  lY 


(iii.)  if  £  ^  0,  a_  0,  but  a+  =  0,  then 


z (t)  =  exp  ( ~—£t  \  z0 - ^£t 

\PoJ  \£\2 

(iv.)  if  l.  a_  and  U  \  are  all  nonzero,  then 

z(f)  =  c(t)  exp  ^-^-^ln(c(£))^  z0  -  j^2^’ 

with  a+  =  a3  +  a2,  a_  =  a\  —  a2,  and  c(t)  =  a+t+p0  ■ 

Proof:  Assume  £  0.  We  will  demonstrate  that  the  center 

of  mass  follows  either  a  circling,  helical,  or  spiral  trajectory 


(31) 
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centered  on  the  point  rj).  We  can  resolve  z  into  component 


vectors  as 


1*1/  1*1 


r  £ 

M  XW\ 


r  £ 

W  XW\ 


The  main  thrust  of  the  proof  is  to  demonstrate  that  the  first 
term  is  identically  zero,  the  second  term  is  linear  in  t,  and 
that  self-contained  dynamics  (and  a  resulting  closed-form 
solution)  can  be  derived  for  the  third  term.  We  address  the 
first  term  by  defining  71  =  ^z  •  ^  j  and  72  =  77.  By  direct 
calculation,  one  can  show  that 

72  =  7«-  +  -  (z  •  r  -  7ia+)  (33) 

2  p 

and  that  the  system  (71,72)  evolves  according  to 


7i=72;  72  =  -~7t  — y 

P2 


By  (30)  we  have 


7l(°)  =  a0  (  T“T  X  777  )  •  7—7  =  0, 


kol  1*1/  kol 


a-  ,  ctq 


a_  a_ 


=  “o  3T7T  K0)  x  iZ-T  -TTi  =0- 


Since  (71,72)  =  (0,0)  is  an  equilibrium  point  for  (34),  we 
have  71  =  (z  •  44 )  =  0,  and  (32)  becomes 


1*1/  1*1 


Now  note  that 


r  £ 

— r  X  — 


r_  e_ 

M  XW\ 


it{zT\)  =  2{xi+X2)T\  =  -W 


and  therefore 


ZW  •  un  =  “iTi*  +  CTo  (t-1  X  —  •  -r  =  -—t.  (38) 


kl  \t\ 


ro|  \t\J  \t\  \i\ 


We  address  the  third  term  in  (32)  by  first  defining 


z  =  z  —  [  z  ■ 


1*1 )  1*1 


r_  £_ 

M  XW\ 


r_  _£_\ 

|r|  x  1*17 


Letting  o-  4  z  •  x 


we  observe  that 


^=cto(nxmJ'InxmJ=C70-  (40) 


and  therefore 

cr(f)  =  cr(0)  -  -j-a_a+i  =  —  (p0  +  a+t)  = 

(42) 

If  a_  =  0,  then  the  third  term  of  (32)  is  identically  zero 
and  (38)  yields  the  the  second  claim  of  our  proposition.  If 
a  /  0,  then  one  can  verify  (by  way  of  (6)  and  the  Jacobi 
identity)  that 

z  =  -  a+l  —  £  z,  (43) 

P  1  J 

and  recognizing  (43)  as  the  same  form  as  (23),  we  therefore 
have  the  analogous  closed-form  expression  for  z.  The  third 
and  fourth  claims  of  Proposition  4  then  follow  from  (38), 
(39),  and  (43),  along  with  the  fact  that  z(0)  =  z(0).  Finally, 
if  £  =  0,  we  have  x,  (t)  =  x°  (from  (27))  and  therefore 
z(t)  =  ^(x^  +  Xj),  establishing  the  first  claim  of  the 
proposition.  □ 

Remark:  System  behavior  can  be  classified  in  terms  of  the 
initial  conditions  (parametrized  by  £  and  0)  and  the  param¬ 
eters  a  .  and  a_.  The  sign  and  magnitude  of  £  determine 
whether  the  baseline  vector  r  will  rotate  (£  ^  0)  as  well  as 
the  direction  of  rotation.  0  determines  whether  r,  xi  and  X2 
will  evolve  in  a  common  plane.  The  parameter  a+  determines 
the  rate  of  change  of  the  inter-particle  distance,  and  a_ 
determines  if  the  center  of  mass  will  rotate.  Figure  1  displays 
some  of  the  possible  system  trajectories,  including  rectilinear 
and  circling  equilibria  as  well  as  an  expanding  spiral. 

V.  Relative  equilibria  for  the  tt-particle  case 

The  analysis  in  [4]  describes  the  possible  types  of  relative 
equilibria  for  an  n-particle  system  evolving  according  to 
(1)  with  .S'/t’(3)-invariant  controls.  These  relative  equilibria 
correspond  to 

1)  rectilinear  formations  (i.e.,  all  particles  move  in  the 
same  direction  with  arbitrary  relative  positions), 

2)  circling  formations  (i.e.,  all  particles  move  on  circular 
orbits  with  a  common  radius,  in  planes  perpendicular 
to  a  common  axis), 

3)  helical  formations  (i.e.,  all  particles  follow  circular 
helices  with  the  same  radius,  pitch,  axis,  and  axial 
direction  of  motion). 

As  in  [4],  we  can  express  our  dynamics  (1)  in  terms  of 
group  variables  <71,  <72,  •  ■  • ,  gn  G  G  =  SE( 3)  as  left-invariant 
systems 

9i  =  gi€i,  i  =  1,2, . . .  ,n,  (44) 

where  =  the  Lie  algebra  of  G.  Then  shape  variables 

can  be  defined  by 

9i  =  9i19i+i,  i  =  1,2,.  ..,n,  (45) 

with  corresponding  dynamics 


By  direct  calculation  we  have 

"  =  -2Ma-a+> 


9i  =  Mi,  i  =  1,2, , . .  •  ,n,  (46) 

(41)  where  —  Ad- -if;  £  g.  Relative  equilibria  for  the 

full  dynamics  are  equifibria  for  the  shape  dynamics  (46). 
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Fig.  1.  These  MATLAB  simulations  illustrate  various  types  of  trajectories  in  terms  of  initial  conditions  {&  and  ©)  and  parameter  values  (a_|_  and  a_). 


In  our  planar  discussion  of  cyclic  pursuit  [2],  we  chose 
appropriate  scalar  variables  to  parametrize  the  shape  space 
and  aid  in  the  analysis.  However,  in  the  current  setting  it 
is  not  readily  apparent  how  best  to  parametrize  the  shape 
space,  and  this  continues  as  a  topic  of  ongoing  research. 
Still,  we  can  make  the  following  statements  concerning  the 
existence  of  particular  types  of  relative  equilibria  in  the  three- 
dimensional  setting. 

Proposition  5:  Given  {ai,  02, . . . ,  a„ },  a  relative  equilibrium 
corresponding  to  rectilinear  motion  on  Mqb( a)  under  closed- 
loop  cyclic  CB  pursuit  dynamics  (17)  exists  if  and  only  if 
there  exists  a  set  of  positive  constants  {<ti,  02,  ■  •  • ,  crnj  such 
that  a‘a‘  =  °- 

Proposition  6:  Given  {ai,  0,2,  ■  ■  ■ ,  an},  define 

{ai,  Q2,  •  •  •  ,  ctra}  £  (0,27t)  by  (cos  a*,  sin  a,)  = 

(—ai,  y/l  —  af  )•  Then  a  planar  circling  relative  equilibrium 
on  under  closed-loop  cyclic  CB  pursuit  dynamics 

(17)  exists  if  and  only  if 

i.  a*  ^  ±1,  i  =  1, 2, . . . ,  n;  ii.  sin  =  0.  (47) 

Proof  of  Propositions  5  and  6:  The  proof  for  each 
proposition  follows  the  same  lines  as  the  corresponding 
proof  for  the  planar  case  in  [2]  and  is  omitted  here  due 
to  space  constraints.  Note  that  the  angle  a,;  as  defined  in 
Proposition  6  matches  the  notation  in  the  planar  proof,  as 
discussed  in  section  III.  (The  choice  of  sinc^  =  —  aj 

corresponds  to  CCW  circling  equilibria,  while  choosing 
sin  on  —  —  \j\  -  af  refers  to  CW  circling  equilibria.)  Also, 
note  that  Proposition  6  addresses  the  existence  of  circling 
equilibria  on  a  common  plane  (rather  than  the  more  general 
definition  of  circling  equilibria  that  permits  multiple  planes 
perpendicular  to  a  common  axis),  and  therefore  the  proof  is 
simplified  by  assuming  (without  loss  of  generality)  that  the 
circling  equilibrium  is  centered  on  the  origin  and  evolves  on 
the  horizontal  plane.  In  particular,  this  enables  us  to  identify 
the  rotation  matrix  R(ai)  £  SO(2 )  (from  the  planar  proof) 
with  the  corresponding  element  in  SO( 3)  by  the  obvious 
inclusion  map. 

Remark:  Observe  that  the  constraint  of  Proposition  5  is 
equivalent  to  requiring  that  either  a*  =  0,  '<  =  1,2,...,  n  or 


that  there  exists  j,  k  €  [1, 2, . . . ,  n]  such  that  a^a*,  <  0.  Also, 
observe  that  the  condition  in  Proposition  5  is  not  mutually 
exclusive  with  the  conditions  of  Proposition  6,  in  contrast 
to  the  analogous  planar  propositions  stated  in  [2], 

VI.  Conclusion 

In  this  paper,  we  have  extended  to  three  dimensions  the 
formulation  and  analysis  of  constant  bearing  cyclic  pursuit 
for  n  interacting  particles.  We  demonstrated  the  existence 
of  an  invariant  manifold  and  then  proved  a  result  on  con¬ 
vergence  to  that  manifold.  In  the  special  case  of  n  =  2, 
conservation  laws  give  rise  to  integrability  of  the  dynamics 
on  the  invariant  manifold.  The  structure  of  the  reduced 
dynamics  on  the  invariant  manifold  for  the  setting  of  general 
n  appears  to  also  permit  conserved  quantities.  Further  details 
along  these  lines  are  under  investigation.  The  results  of  this 
paper  contribute  to  our  understanding  of  the  idea  that  pursuit 
strategies  offer  building  blocks  for  collective  behavior. 
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